gLite Job Provenance
نویسندگان
چکیده
The Job Provenance (JP) service is designed to automate keeping track of computations on large scale Grids, giving thus users a tool to correctly archive information about their jobs and to re-submit any job in a reconstructed environment. JP provides a permanent minimal record of job (and its environment) related information, to which free-form user annotations can be added. JP also offers the capability of configuring any number of indexed logical views on the large collections of raw data, allowing efficient processing of even complex user queries selecting on both system data and the annotations. The scalable architecture, capable to handle millions of jobs in a single JP installation, and integrated into the EGEE gLite middleware environment is presented.
منابع مشابه
gLite Job Provenance - a job-centric view
A general requirement in the environment of traditional experimental science states that any result must be verifiable by redoing the experiment. Nowadays, many “experiments” are carried in a virtual environment as computations. However, the same principle applies – a result of a computation is questionable and generally not accepted by the community if it is not verifiable by an independent co...
متن کاملDesign and implementation of the gLite CREAM job management service
Job execution and management is one of the most important functionality provided by every modern Grid systems. In this paper we describe how the problem of job management has been addressed in the gLite middleware by means of the CREAM and CEMonitor services. CREAM (Computing Resource Execution and Management) provides a job execution and management capability for Grids, while CEMonitor is a ge...
متن کاملJob submission and management through web services: the experience with the CREAM service
Modern Grid middleware is built around components providing basic functionality, such as data storage, authentication, security, job management, resource monitoring and reservation. In this paper we describe the Computing Resource Execution and Management (CREAM) service. CREAM provides a Web service-based job execution and management capability for Grid systems; in particular, it is being used...
متن کاملCream: a Simple, Grid-accessible, Job Management System for Local Computational Resources
Efficient and robust system for accessing computational resources and managing job operations is a key component of any Grid framework designed to support large distributed computing environment. Computing Resource Execution and Management (CREAM) is a simple, minimal system designed to provide efficient processing of a large number of requests for computation on managed resources. Requests are...
متن کاملExploring Provenance in a Distributed Job Execution System
We examine provenance in the context of a distributed job execution system. It is crucial to capture provenance information during the execution of a job in a distributed environment because often this information is lost once the job has finished. In this paper we discuss the type of information that is available within a distributed job execution system, how to capture such information, and w...
متن کامل